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1 Introduction 


Forward-backward-forward splitting algorithm was firstly proposed in [24] for solving the problem 
of finding a zero point of the sum of a maximally monotone operator A: TL — >• 2^ and a mono¬ 
tone Lipschitzian operator C: t where is a real Hilbert space. This splitting algorithm 

plays a role in solving a large class of composite monotone inclusions [3] and monotone inclusions 
involving the parallel sums m HU nni IS] as well as applications to conposite convex optimization 
problem involving the infimal-convolutions [3 El El [13 H. However, these works are limitted to 
deterministic setting. 

Very recently, we have found out in the literature that there appears the study of some splitting 
algorithms for solving monotone inclusions in the stochastic setting as in HU 123118], and primal- 
dual splitting algorithm for composite monotone inclusions in [m HBj. Some iterations in m 
EUl [15] are designed for monotone inclusions involving cocoercive operators. For solving monotone 
inclusions involving Lipschitzian monotone operators, one can often use the iterations which has the 
structure of the forward-backward-forward splitting methods as cited above, but the convergence 
of their proposed methods is no longer available, in the literature, in the stochastic setting. 
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The objective of this note is to study the convergence of the forward-backward-forward splitting 
in the stochastic setting for monotone inclusions involving Lipschitzian monotone operators as well 
as for composite monotone inclusions involving parallel sums. 

In Section^ we recall some notations, background and preliminary results. We prove the almost 
sure convergence of the stochastic forward-backward-forward splitting algorithm in Section [3l In 
the last section, we provide applications to composite monotone inclusions involving the parallel 
sums as well as minimization problems involving infimal convolutions. 


2 Notation—background and premilary results 


Throughout, Ti, G, and {Gi)i<i<m are real separable Hilbert spaces. Their scalar products and 
associated norms are respectively denoted by (• | •) and || • ||. We denote by “B (91,0) the space of 
bounded linear operators from H to Q. The adjoint of L G is denoted by L* . We set 

B ij-i) = B{'H,'H). Id denotes the identity operator. The symbols ^ and ^ denote weak and 
strong convergence, respectively. We denote by I'+(N) the set of summable sequences in [0,-|-oo[. 
The class of all proper lower semicontinuous convex functions from T-L to ]—oo,-|-oo] is denoted 
by To{T-L). Let Mi and M 2 be self-adjoint operators in B (T-L), we write Mi M 2 if and only if 
(Vx € Ti) {Mix I x) > {M 2 X I x) . Let a G ]0, -|-oo[. We set 

Ba{Ti) = {M eB{Ti)\M* = M and M aid}. (2.1) 

Let A: Ti ^ 2^ he a set-valued operator. The domain of A is domH = {x gT-L \ Ax / 0 }, 
and the graph of A is graH = {^{x,u) G Ti x Ti \ u G Hxj. The set of zeros of A is zerH = 
{x G ^ I 0 G Hx}, and the range of A is ranH = {u gTLI {3 x gTL) u G Hx}. The inverse of A is 
A-^: Ti 2^ ■. u !-->■ |x G I u G Hx}, and the resolvent of A is 

JA = {ld+A)-\ ( 2 . 2 ) 


Moreover, A is monotone if 

(V(x, y) gT-L X T-i)(y{u, v) G Ax x Ay) {x — y\u — v) >h, (2.3) 

and maximally monotone if it is monotone and there exists no monotone operator H—)• 2^ such 
that graH C graH and A ^ B. We say that A is uniformly monotone at x G domH if there exists 
an increasing function (pA ■ [0, -|-oo[ —>■ [0, -|-oo] vanishing only at 0 such that 

(Vm G Hx) (V(y, u) G graH) {x — y \ u — v) > (Pa{\\x — y\\). (2.4) 

Given a probability space (Li,.^, P), we denote by cr(x) the cr-field generated by a random 
vector x: ft ^ Ti, where Ti is endowed with the Borel cr-algebra. The expectation of a random 
variable x is denoted by E[x]. The conditional expectation of x given a sub-sigma algebra T GL T 
is denoted by E[x|J^]. The conditional expectation of x given y is denoted by E[x|y]. 
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Lemma 2.1 [531 Theorem 1] Let (.^n)neN an increasing sequence of sub-sigma algebras of T. 
For every n E N, let Zn, f,n, Cn and tn be non-negative, ^n-measurable random variable such that 
(Cn)neN and (tn)neN are summable and 

(Vn E N) Fi[Zn+\\Tn] < (1 + tn)Zn + U - P-a.S. (2.5) 

Then converges and {f,n)neN 'Is summable P-a.s. 

Lemma 2.2 [T2l Proposition 2.3] Let FL he a real separable Hilbert space, let C be a non-empty 
closed subset of H, let 4>-. [0,oo[ ^ [0, oo[, let {xn)neN be a sequence of random vectors in H. 
Suppose that, for every x G C, there exist non-negative summable sequences of random variables 
{Cn{x))neN and {tn{x))n£n such that, for every n E N, Cnix) and tn{x) are Tn = (^{xq, .. . ,Xn)- 
measurable, and 

(Vn E N) E[(()(||x„+i-x||)|:F„] < (l + t„(x))(/)(||xn-x||) + Cn(a^) P-a.s. (2.6) 

Suppose that 4> is strictly increasing and limg_).oo <?^’(0 = +oo. Then the following hold. 

(i) (||x„, — x||)nGN 'Is bounded and converges P-a.s. 

(ii) There exists a subset ft* with P(f2*) = 1 such that for every x G C and every uj G ft*, 
(||xn(a;) - x||)neN converges . 

(hi) (xn)neN converges weakly P-a.s. to a C-valued random vector if and only if every its weak 
cluster point is in C P-a.s. 

Remark 2.3 A sequence (xn)nGN satisfying ()2.6p is called a stochastic (/)-quasi-Fejer monotone 
with respect to the target set C. The connections of Lemma 12.21 to existing work can be found in 
[T2l Remark 2.4]. 


In view of the work in m Theorem 3.3], we also have a variable metric extension of Lemma 

\2m 

Proposition 2.4 Let H be a real separable Hilbert space, let C be a non-empty closed subset of 
H, let (f: [0,oo[ —>■ [0,oo[, let a G ]0,oo[, let W G TafH) and (ITn)neN a sequence in 7a{H) 
such that Wn —>• W pointwise, let (xn)nGN be a sequence of random vectors in H. Suppose that, 
for every x gC, there exist non-negative summable sequences of random variables (Cn(a;))nGN and 
{tn{x))n£f>i such that, for every n E N, (nix) and tn{x) are Tn = o'(xo ,..., Xn)-measurable, and 

(Vn E N) E[(j){\\Xn+l - x\\w„+i)\Tn] < {1-\-tn{x))(l){\\xn - x\\wjCn{x) P-a.s. (2.7) 

Suppose that cf is strictly increasing and lim^_>.oo (/)(.^) = -|-oo. Then the following hold. 

(i) {\\xn — a:llu/„)ngN I'S bounded and converges P-a.s. 

(ii) There exists a subset ft* with P(f2*) = 1 such that for every x G C and every oj G ft* , 
{\\xn{ui)- xllw„)neN converges . 
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(iii) (xn)neN converges weakly P-a.s. to a C-valued random vector if and only if every its weak 
cluster point is in C P-a.s. 


Proof, (i): Set (Vn G N) = \\xn — It follows from (|2.7I) and Lemma [2TT] that (^(^n))neN 

converges P-a.s., say f>(^n) A. In turn, since limt^+oo = +oo, (fn)neN is bounded P-a.s. 
Let uj G fl such that (fn(‘^))neN is bounded and, to show that it converges, it suffices to show 
that it cannot have two distinct cluster points. Suppose to the contrary that we can extract two 
subsequences (4„(w))neN and such that 4„(w) ^ r/(iv) and C(‘^) > 

and fix e G ]0, (C — '^)/2[. Then, for n sufficiently large, < rjioj) -|- e < C,{uj) — e < and, 

since (p is strictly increasing, (pifk^i^)) < + e) < 4'{C{^) “ s) < 4'iCini^))- Taking the limit 

-|-oo yields X{uj) < p{r]{u}) -|- e) < — e) < A(cu), which is impossible. 


as n 


(ii) Since PL is separable, so is C and hence there exists a countable subset X of C such that 


X = C. In view of (i), for each x G X, there exists a subset Clx with probability 1 such that 
(||xn(a;) — x||w„)neN converges for every iv G fix- Define ft* = Since X is countable, 

P{fl* ) = 1. Now, let xo G C and wq G fi*. Then, there exists a sequence {ck)ke¥i in such that 
C/c 


xq. By (i) we have 


{yk G N)(3rfc : n ^ [0, -Foo[)(Va; G ficj ||xn(w) - Ck\\w„ ^ Tkiuj). 


( 2 . 8 ) 


Moreover, set p, = sup^^jsj ||ITn||. Then p < -|-oo by Banach-Steinhaus Theorem. Then, for every 
n G N and /c G N, we have 

—y/pW^k — a^oll < —\\ck — < ||a^n(wo) — a^ollu/n “ Ikn(wo) — Ck\\wn ^ W^k — xqWw^ 

< V^llcfc - xo||. (2.9) 

Therefore, 


(VA; G N) -^/p\\ck-xo\\< lim ||x„(a;o) - xo||tv„ - lim ||xn(a;o) - Cfc||iv„ 

n—>-oo n—>-oo 

= lim ||xn(a;o) - xo||iy„ - rfc(a;o) 

n—>-oo 

< lim ||x„(a;o) - xq\\w^ - rfc(a;o) 

n—Poo 


< v^llcfc - a^oll- 

Now, let k —>■ oo, we get lim„_,.oo ||a;„(a;o) — a^ollwn = hm^. 


,Tk{uJo) which proves (ii 


( 2 . 10 ) 


(iii) Necessity is clear. To show sufficiency, let D be the set of all w such that every weak 


sequential cluster point of (xn(w))neN is in C. Then fl has probability 1, so is D* = D n fi*. Let 
a; G D* and x(a;) and y{uj) be two weak cluster points of {xn{u}))n£N, say Xk^{u}) x{u) and 
xpi^) y{^)- Then it follows from p)] that (||xn(a;) - x(a;)||w„)neN and (||x„(a;) - y(w)||w-„)nGN 


converge. Moreover, ||x(a;)|p = (ITnx(w) | x(a;)) 
{Wy{uj) I y{oj)). Therefore, since 


(ITx(a;) I x(a;)) and, likewise, \\y{uj) 


\Wn 


(Vn G N) (ITnX„(a;) | x(a;) - y{uj)) = -(||x„(a;) - y{uj)\\w„ - lkn(w) - x{u)\\w^ 

+ \\x{^)\\w„ ~ \\yi'^)\\wn)^ ( 2 . 11 ) 
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the sequence {{WnXn{<^) \ x{oj) — ?/(a;)))„gN converges, say iyVnXn{oj) \ x{uj) — y{oj)) A(a;) G M, 
which implies that 

(Xn(w) I Wn{x{uj) - y{uj))) X{u) G M. (2-12) 

However, since Xk„{oj) x{ijj) and Wk^{x{uj) — y{uj)) —)• W{x{uj) — y{uj)), it follows from (I2.12p 
and [5l Lemma 2.41(iii)] that {x{uj) \ W{x{uj) — y{oj))) = A(a;). Likewise, passing to the limit along 
the subsequence (xz^(w))neN in (I2.12p yields {y{oj) \ W{x{uj) — y{oj))) = A. Thus, 


0 = (x(w) I W{x{uj) - y{u}))) - {y{u}) \ W{x{u}) - yicv))) = (x(w) - y{oj) \ W{x{uj) - y{uj))) 

> a\\x{uj) - y{uj)\\^. (2.13) 


This shows that x{oj) = y{oj). Upon invoking (ii) and O Lemma 2.38], we conclude that Xni<x) 
x{uj) and hence we obtain the conclusion. □ 


3 A stochastic forward-backward-forward splitting algorithm 


The forward-backward-forward splitting algorithm was firstly proposed in [24] to solve inclusion 
involving the sum of a maximally monotone operator and a Lipschitzian monotone operator. In 
[3], it was revisited to include computational errors. Below, we extend it to a stochastic setting. 
The following theorem is a stochastic version of [251 Theorem 3.1]. 


Theorem 3.1 Let 1C he a real separable Hilbert space with the scalar product {{■ \ •)) and the 
associated norm ||| • |||. Let a and (3 be in ]0,-|-oo[, let he a sequence in and let 

(t/n)neN be a sequence in 23 (/C) such that 

pL = sup \\Un\\ < +00 and (V® G /C) (1 -|- rin){{x \ Un+ix)) > {{x \ Unx)) > a|||£c|||^. (3.1) 

n£N 

Let A: K ^ 2^ be maximally monotone, let B: K ^ K be a monotone and fd-Lipschitzian operator 
on K such that zer(A + B) ^ 0. Let (a„)„gj^, (bn)neN; o,nd {cn)neN be sequences of square 
integrable K-valued random vectors. Let xq be a square integrable K-valued random vector, let 
e G ]0, l/(/S/U -|- 1)[, let (7n)nGN be a sequence in [e, (1 — e)/(/3/u)], and set 


(Vn G N) 


Vn — Xfi ni^BXji H dji) 

Pn ~ J^nUriAUn + b>n 
Qn=Pn- InUniBPr, + C„) 

. ®n-|-l = Xn — 


(3.2) 


Suppose that (y^E[|||a„|||2|:F„])^^pj, (^E[|||6„|||2|:F„])^gj^, and (y^E[|||c„|||2|:F„])^gj^ are summable 
P-a.s., the following hold for some zer(A -|- B)-valued random vector x. 


(i) EnGNE[|||®n -PnllPl^n] < +00 and EnGNE[|||l/n “ Qn\\\^\^n] < +00 P-O.S. 

(ii) Xyi ^ X and J^„u„A.(.Xn nBxjf^ ^ x P-^.s. 

(hi) Suppose that one of the following is satisfied for some subset Cl C ft with P(r2) = 1. 
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(a) A + B is demiregular (see Definition 2.3]) at x(uj) for every w € 

(b) A or B is uniformly monotone at x{uj) for every w G 

Then Xyi v x and ^ ^ P-(i.5. 


Proof. It follows from m Lemma 3.7] that the sequences {yJnGN, {Pn)neN and {qJnGN 

are well defined. Moreover, using m Lemma 2.1(i)(ii)] and (13.11) . for every sequence of random 
vectors /C-valued (2;n)nGN) we have 

\/E[|||z„||P|:F„] < +00 P-a.s. ^ y/e[|||z„|||^_i|:F„] < +oo P-a.s. (3.3) 

nGN 


and 


Y, VmW^nm^n] < +00 P-a.s. 

nGN 


y^E[|||z„|||^^|.^„] < -boo P-a.s. 

nGN 


Let us set, for every n G N, 


/ ~ 

Vn — '3nU riBXn 

Pn = J-tnUnAVn 
Qn=Pn- InUnBp^ 

^ ^n+l — ~ Vn A Qni 


and 


'Un = - Pn) + Bpn - BXn 

^ — ^n+1 ^n+1 

dn = qn-Qn + Vn-yn- 


Then (13.5p yields 

(Vn G N) Un= ifi^Un^i Vn “ Pn) + BPn G Apn + Bpn, 


(3.4) 


(3.5) 


(3.6) 


and dSSD, Lemma [141 Lemma 3.7(ii)], and the Lipschitzianity of B on JC yield 


(Vn G 


WVn - VnlWu-^ 
I \Pn Pn\ I \u~^ 
Il^n “ 9nlI 


— 11 l®n.| I lc/“l 


I M n 


-ii 


bn||lc/-l + ifip) 

< 2(1 I 16,^111 jy-l -|- (/ 3 /i) 




.- - _ ._ \an\\\u^) + {fip) ' 

Since (v^EnMFra)„eN’ (v^E[pJ|Fra)„6N, and (^£[^7^), 
P-a.s., using Jensen’s inequality, we derive from (|3.3D . (13.41) . (13.5]) . and (|3.7I) thi 


(3.7) 

77 I I I XJ n ■ 

are summable 


'EnGNE[|||p„ -Pnllll^rx] < +00 and EnGN ^[11 |p„ “ Pnl I lt/-l l^n] < +00 P-a.S. 

’ EnGNE[|||qn - Qnllll^n] < +00 and EnGN E[| | l^n “ Qnl I It/'l < +00 P-a.S. (3.8) 

.EnGN^IIII^nllll^ri] < EnGNE[lll^nlllt/-l|^ri,] < +00 P-a.S. 

Noting that 

2E[|||p„ — y,^|||jy-i|.^n] < 2(/?/r) E[|||a„|||jy |.^„], (3.9) 

and 


2E[|||q„-q^ 


|2 I ^ 

I I*' 71 


<24(E[|||6„ 


|2 I -p 


] + (/3m)-^E 


\ar. 


|2 

\Un 


-b 


|2 

\Ur, 


|:E,]) (3.10) 
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Therefore, upon setting c = max{26(/3/r) 24}, and adding (|c{.9p and (l3.1Up . we get 


2E[|||y„ — y„|||^_i|:F„] + 2E[|||q„ — q„|||^_i|^„] < c(E[|||a„||||j^|:F„] + E[|||6n,|||^_i|:F„] 

+ E[|||c„|||^j:r4. (3.11) 

Now, using (13.lip . (I3.33p . (13.3411 . p3.3p . (13.411 and (13.5p . we have 
j;E[|||d„|||^_i|:r„]<2^E[|||y„-yJ||2^_i|:r„] + 2^E[|||q„-qJ||2^_i|:r„] 


neN 


ngN 


ngN 


< C Y.^[\\\an\\\lj^J^n] + J2m\K\\\lj-l\^n] + E[| | |c„| 1 


ngN 


ngN 


ngN 


< cro ^ jE[|||a„|||^J:r„] + ^ JE[\\\h 


ngN 


< +00 P-a.s., 


n£N 


2 I TT 

•/ n 


^1 I lf/-l I*' 


+ E\/'^[ 

tt-GN 


l^n|||(7^|-^n] 


(3.12) 


where we define 


To = sup 

nGN 


EHIIa, 


|2 

\Ur, 


Eniih. 


|2 

'u- 


E[ 


|2 

\Ur, 


< +00 P-a.s. 


(3.13) 


Now, let X G zer{A + B). Then, for every n G N, {x, —^nUnBx) G gTa{'ynUnA) and (|3.5I1 
yields — p„) G gra( 7 „L/'„A). Hence, by monotonicity of UnA with respect to the 

scalar product ((• | •))jy-i, we have {ip^ — x \ — ^nUnBx))jj-i < 0. Moreover, by 

monotonicity of UnB with respect to the scalar product ((• | •)){ 7 -i, we also have ((p„ — a; | 
'fnUnBx — 'ynUnBp^))jj-i < 0. By adding the last two inequalities, we obtain 

(VnGN) {{p^-x\p^-y^-'ynUnBp^))u-i <0. (3.14) 

In turn, we derive from p3.5ll that 


(Vn G N) 2 -/n{{Pn - ® I UnBXn - UnBp^))^-l 

= 2((p„ -x\p^-y^- -fnUnBp^))jj-l 
+ ‘^{{Pn - X I 'JnUnBXn + “ Pn))u-^ 

< ‘^{{Pn - X I JnUnBXn + “ Pn))u-^ 

= ^{{Pn -x\Xn- Pn))u-^ 

11 \ Xn ®l I Irj-l II |Pn ®l 1 117-1 II \ Xn Pnl 1 117-1' ( 3 . 15 ) 

n 71 ^ n 
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Hence, using (13.51) . (|3.15|) . the /3-Lipschitz continuity of B, and m Lemma 2.1(ii)], for every n G N, 
we obtain 


11 |®n+l ®llli 7 -l lllQn~l" Vn I l[/-l 

= IIKPn - +lnUn{BXn - Bp 


n}\\\iJ- 


= IllPn - +27n((Pn-® | Bx^ - Bp^)) 

+ InlWniBXn - Bp 


nJlWij- 


— Ill^n ^lllr/—1 lll^n I Irr—l 


y 2..«2 

In 


+ - Pn 


<\\\Xn- X\\\l ^ ^\\\Xn-Pn\\? 


+ llpf\\\Xn-Pn 


Hence, it follows from (|3.ip and [131 Lemma 2.1(i)] that 

(Vn G N) |p„+i-®|||^ 1 < (l + 7 „)|p„-®"'^ 


n + 1 


u- 


-/^ (1 -7n/3 )IPn-P; 


Consequently, 


(Vn G N) 3?|||jy—1 ^ (1 “h ^n)|||^n ^ 


n + 1 


\u- 


For every n G N, set 


= \//^«“^(2(|||&n||lt/-i + (/3/i) ^|||a„|||j7„) + (/3^) tl|cn|||t/„ + (/3l^) 


-ii 


\0-n\\\Ur, 


(3.16) 


(3.17) 

(3.18) 

(3.19) 


Then (Epp„])„£N is summable P-a.s. by ([3.31) and we derive from [T3l Lemma 2.1(ii)(iii)], and 
(j3.8p that 


(Vn G hi) lll^nllliy—1 — |||®n+l ®n+l|||f 7 -l 

n+1 n+1 

7 yfu ^11 XjiJ^\ 111 

< pa-^\\\Xn+l - Xn+l\\\u-l 

< v//ia-l(|||y„ - yn\\\u-l + IPn - fln\\\u-^) 

< Sn- (3.20) 

In turn, we derive from (I3.18p that 

(Vn G N) III X^^i ® 111 U~^_^ — 11 l®n+l ® 111 U~^i V 111 Xn+l ®n+l 111 

— Ill®n+1 ®lllf7“l T 

n+1 

< (1 +7n)|pn - ®|||j 7 -l +en- (3.21) 

By assumption, since E[||a;o|p] is finite, by induction, for every n G N, E[||a;„|p] is finite and hence 
E[|| a;„||] and E[||a;„||jy-i] are finite too. By taking the conditional expectation with respect to 
and note that Ipn — ®lllr;—i is .^n-measurable, we obtain 

(Vn G N) E[|p „+1 - x\\\jj-^JJ^n\ < (1 + 7n)|pn - ®lllu--i +Ep|:F„]. (3.22) 
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This shows that {xn)neN is | • |-quasi-Fejer monotone with respect to the target set zer(A + S) rela¬ 
tive to {U~^)n£^- Moreover, (|||a;„ —a;|||jy-i)„gN is bounded. In turn, since B and {J-y^u„A)nGN are 
Lipschitzian, and (Vn E N) ® = J-y^u^Aix—'jnUnBx), we deduce from (|3.5I) that (y„)nGN) {Pn)neN, 
and (q„)neN are bounded. Therefore, 


T = sup{|||a;„ - - *111^-1, |||®„ - a;|||^-i} <+00 P-a.s. (3.23) 

nGN 


Hence, using (|3.5p . Cauchy-Schwarz for the norms 
n E N, 

lll®n-rl - ®|||rr-l = 11 |®n “ I lr/-l 


\U 


-i)ngN, and (|3.16|) . we get, for every 


= \\\Qn+Xn-yn-X + d 


u- 


— 11 l^n T Vn 11 U~^ ^11 l^n T Vn I \u~^ 11 \ \ u~ 

^ n 

< |||a;„ - - 'jl/3^fi‘^)\\\Xn -Pn\\\^ + ^l,n, 


(3.24) 


where (Vn E N) ei^n = 2|||q„ + Xn — Vn — ®lllc/-i|ll*^nlllc/-i + ll|r^n|||^-i- In turn, for every n E N, 
by (13.ip and [T3l Lemma 2.1(i)], 


|||®n-|-l ®lllr/ —1 — (i- T V)i)lll®)i +1 ®lll( 7—1 

^ n + 1 ^ 


< {1 + 7]n)\\\xn - x\\\ I - ^ (1 - 7„/3 /i )11|a;„ - p„|11 

n 

+ (1 + f]n)£l,n- (3.25) 

Since, ° (Jd—'jnB) is continuous, is .^„-measurable. In turn, for every n E N, 


E[|||®n+1 - < (1 + r]n)\\\Xn - X\\\fj.i - ^ (1 - 7^/3>^) 111 - p, 


71 + 1 


+ E[(l -|- r7n)£l,n|-^n]- 


(3.26) 

(3.27) 


Let us prove that 

^E[ei,n|^n] < - 1-00 P-a.s. 

neN 

Indeed, since Id —^nB is continuous, and are .^n-measurable. Therefore, |||a;„ — -|- — 

a;|||jy-i is .^n-measurable and hence by ()3.8p and ()3.23p . we obtain 

'^B[\\\Xn-yn + qn-x\\\u-l\\\dn\\\u-l\Tn] = ^ 11® 111 j^-l E[| 11 111 |:F„] 

neN 


neN 

— 'T E[ll|r^n|||[/7l|i^n] 

neN 

< -|-oo P-a.s., 


which and (|3.12p prove (|3.27l) . It follows from Lemma 2.1 that 

^ IllaJn — p^lll^ <- 1-00 P-a.s. 

nGN 


(3.28) 


(3.29) 
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(i): It follows from (j3.29p and (|3.8p that 


'^M\\Xn-Pn\\?\^n] < 2 ^ 111 11 + 2 ^ E[| | |p„ - 111 ^ |:F„] < +00 P-a.s. (3.30) 

nGN nGN n€N 


Furthermore, we derive from (13.8p . (|3.3p and (I3.12p that 
E[|||y, - qj||2] = ^ E[|||q„ -y^ + dn\\\^\Tn] 

n^N n€N 

— ^ ^ ^[| I \ 'Pn 'ynUri{BXji -\- dn \ \ \ n\ 

nGN 

<3(^'^\\\Xn-Pn\\\^ + E[\\\jnUn{BXn - BpJ\\\^ + 111 d„ 11 ^ |:F„]^ 
neN 

< +00 P-a.s. (3.31) 


(h) Let fio be the set of all w E Li such that (a;„(u;))neN is bounded and (I3.29p is satisfied. We 
have P(rio) = 1- Fix to E CIq. Let x{uj) be a weak cluster point of (a;ri,(w))nGN- Then there exists 
a subsequence (aj^^(a;))ngN that converges weakly to x{uj). Therefore Pf,^{uj) x{uj) by (I3.29P 
and by the dehnition of fio- Furthermore, it follows from (|3.5p that Uk„{u}) —>• 0. Hence, since 
(Vn E N) [pk^ (w), (w) ) E gra(A + B) , we obtain, x{lo^ E zer(A -)- B^ Proposition 20.33(ii)]. 

Altogether, it follows Proposition 12.41 that x^ ^x and hence that p^ x. 

Now, let Lii be the set of all w E such that Xn(uj) x{u}) and p„(w) ^ ®(w), and p^i^) — 
Xn{oj) —)• 0. Then P(rii) = 1 and hence P(rii n fi) = 1. 


(iii)(a) Fix w E n fi. Then Xn(uj) x{uj) and Pni^) x{u)). Furthermore, it follows 
from (13. 5p that Un{oj) —^ 0. Hence, since (Vn E N) (p^{u}),Un{uj)) E gra(A -|- B) and since A -1- .B 
is demiregular at x{ijj) by our assumption, by [U Dehnition 2.3], p„(w) —>■ x{lj), and therefore 
Xn{u}) —)• x{ljj). 


(iii)(b) Fix cu E Lii (h Li. If A or B is uniformly monotone at x{u)), then A -|- B is uniformly 


monotone at x[uj). Therefore, the result follows from [U Proposition 2.4(i)]. □ 


Corollary 3.2 Let 1C be a real separable Hilbert space with the scalar product {{■ \ •)) and the 
associated norm ||| • |||. Let j5 he in ]0, +oo[, let A: /C —)■ 2^ he maximally monotone, let B: K ^ K 
he a monotone and /3-Lipschitzian operator on K, such that zer(A-l-B) ^ 0. Let {an)n£N, {bn)n£N, 
and (c„)„gp} be sequences of square integrable K-valued random vectors. Let xq be a square integrable 
K-valued random vector , let e G ]0, l/(/3 -|- 1)[, let (7n)neN be a sequence in [e, (1 — e)//3], and set 


(Vn E N) 


Vn — 'yn{BXn T 

Pn ~ J'ynAl/n T 
Qn=Pn- ln{Bp^ + Cn[ 
^n+l — ~ Vn T Qn- 


(3.32) 


Suppose that the following conditions are satisfied with Tn = ct^xq, . 


,Xr 


EAI 

nSN 


\ar. 


\Tn] < OO, ^ -v/EPIIIhnllPlJF^] < oo 
nGN 


(3.33) 
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and 


(3.34) 


\/E[|||c„||| 2|:F„] < OO P-a.s. 

neN 

Then the following hold for some zer(A + B)-valued random vector x. 


(i) EnGNE[|||®n -PnllPl^n] < +00 and EnGNE[|||Z/n “ Qn\\\^\^n] < +00 P-a.S. 

(ii) ^ ^ and ^ x P-ci.5. 

(iii) Suppose that one of the following is satisfied for some subset fl C ft with P(r2) = 1. 

(a) A + B is demiregular (see m Definition 2.3]) at x{uj) for every w € 

(b) A or B is uniformly monotone at x(uj) for every uj £ ft. 

Then Xn ^x and J'jnAixn — InBxn) —> x P-a.s. 

Remark 3.3 Here are some remarks. In the case when R is a general multi-valued maximally 
monotone operator or a cocoercive operator, the almost sure convergence of the Douglas-Rachford 
or forward-backward are proved in [12] under the same type of condition on the stochastic errors. 
Furthermore, in the case when B is cocoercive and uniformly monotone, the almost sure conver¬ 
gence of the forward-backward splitting is also proved in [20| under different conditions on stepsize 
and stochastic errors. One of the early work concerns with Lipschitzian monotone operator was in 
HZ]. 


Example 3.4 Let f : K. ^ [—oo,-|-oo] be a proper lower semicontinuous convex function, let 
a G ]0,-|-oo[, let fi G ]0,-|-oo[, let R: /C —)• /C be a monotone and /3-Lipschitzian operator. Let 
{an)neN, (bn)neN) and (c„)„gN be sequences of square integrable /C-valued random vectors such 
that (I3.33P and (|3.34|) are satisfied. Furthermore, let xq be a square integrable /C-valued random 
vector, let e G ]0, min{l, l/(/3 -|- 1)}[, let (7n)nGN be a sequence in [e, (1 — e)/fi]. Suppose that the 
variational inequality 

find X £ K such that (Vy G /C) {x — y \ Bx) -|- f(x) < f{y) (3.35) 


admits at least one solution and set 


Then, 


(Vn G N) 

for almost all a; G 


Vn — 3n{-^^n T ®?i) 

Pn = argmin(/(a;) + ^|||a;-y„|||2) + bn 

Qn=Pn- ln{BPn + Cn) 

_ ^n+l — ~ Pn 4 " Pn- 

(xn(cij))neN converges weakly to a solution x(uj) to (|3.35n . 


(3.36) 


Proof. Set A = df in Corollary 13.^1 ii)[ □ 

Remark 3.5 Since ( 7 n)neN is bounded away from 0, we have 

^ 7 n = +00 and ^ 7 ^ = -^ 00 . (3.37) 

nSN ngN 
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While, in the standard stochastic gradient method m, we often require 

^ 7n = +00 and < +oo- (3.38) 

nSN ngN 

Under the condition (13.381) . the conditions on the stochastic errors in the stochastic gradient method 
are weaker than (I3.33|) - (l3.34j) (see also [26l Assumption 2 and Eq (4) ] for the case of the projected 
stochastic gradient method). 

We end this section by noting that, in the case when Un = U, we obtain a preconditioned version 
of ()3.32p . Some other preconditioned algorithms can be found in [T8l 1^ . 


4 Monotone inclusions involving Lipschitzian operators 


The applications of the forward-backward-forward splitting algorithm considered in [a HI [21] can 
be extended to a stochastic setting using Theorem 13.11 As an illustration, we present a stochastic 
version of the algorithm proposed in HI Eq. (3.1)]. Recall that the parallel sum oi A: T-L ^ 2^ 
and R: —)• 2^ is [5| 

ADB = {A-^ + (4.1) 


Problem 4.1 Let ^ be a real separable Hilbert space, let m be a strictly positive integer, let 
2 G "R, let A: ^ 2^ be maximally monotone operator, let C: Ti ^ Ti he monotone and uq- 

Lipschitzian for some uq G ]0, -|-oo[. Eor every i G {l,...,m}, let Qi be a real separable Hilbert 
space, let Vi ^ Qi, let Bi: Qi ^ 2®* be maximally monotone operator, let ; Qi ^ 2^* be monotone 
and such that D~^ is z/j-Lipschitzian for some Vi G ]0,-|-oo[, and let Li'. T-L ^ Qi he a nonzero 
bounded linear operator. Suppose that 

z G ran (a + ^ ^ L*[{Bi □ Di){Li ■ — r^)) -|- . (4-2) 

i=l ' 


The problem is to solve the primal inclusion 

m 

z G Ax + Y,Li{iBiaDi){LiX-ri))+Cx, (4.3) 

i=l 


and the dual inclusion 


(Vi G {!,...,m}) 


Tj G —Li[A C) 



-h ^Vi + D- ^Vi. 


We denote by V and V be the set of solutions to (14.3p and ()4.4p . respectively. 


(4.4) 


As shown in H, Problem 14.11 covers a wide class of problems in nonlinear analysis and convex 
optimization problems. However, the algorithm in H Theorem 3.1] is studied in the deterministic. 
The following result extends this result to a stochastic setting. 
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Let us define /C = ^ © • • • © Qm the Hilbert direct sum of the Hilbert spaces T-L and 

iGi)i<i<m, the scalar product and the associated norm of K respectively defined by 


((• I •)): iix,v),iy,w)) (x I y) + I Wi) and ||| • |||: {x,v) ^ 


2=1 


1 


UE 


+ (4-5) 


2=1 


where v = {vi,..., Vm) and w = (rci,..., Wm) are generic elements in Qi 


Corollary 4.2 Let (ai_n)neN) (&i,n)neN 7 ond (ci^n)neN sequences of square integrable LL-valued 
random vectors, and for every i G {1,... , m}, let (a 2 ,i,n)neN) ib 2 ,i,n)neN, and (c 2 ,j,n)nGN be sequences 
of square integrable Qi-valued random vectors. Furthermore, set 




max{r'0 5 ■ ■ 


m 


E'm} + 



(4.6) 


let xo be a square integrable FL-valued random vector, and, for every i G m}, let Vifi be 

a square integrable Qi-valued random vector, let e G ]0,1/(1 +/3)[, let (7n)neN be a sequence in 
[e, (1 — e)//3]. Set 


(Vn G N) 


yi,n — 'yn{CXn © © 0,l,n) 

Pl,n — ■J'ynA{yi,n © 
for i = 1,... ,m 

2/2,i,n — Vi^n © '^ni^FiXn Vi^n © ®2,i,n) 

P2,i,n — Jy^j^—^iy2,i,n 'Yn'f'i') © &2,i,n 
Q2,i,n — P2,i,n © P2,i,n © C2,i,n) 

_ Vi^n+l — Vi^n 2/2,i,n © Q2,i,n 

Ql,n — Pl,n 'yn(^Cpi,n © X^i=l ^iP2,i,n © ei,n) 
Xn+1 — 2/1,n © Ql,n- 


(4.7) 


Suppose that the following conditions hold for Tn = o'((xfc, {vi^k)i<i<m)o<k<n, 


X/n€N \/E[| 11 (cil,n) {o-2,i,n)l<i<m) \ \ P l-^n] © ©OO 

< EneN ^ /E[||(6l,n,(b2,^,n)l<^<n^)||P|^n] < ©OO (4.8) 

, EneN \/E[| 11 (ci^n; {c2,i,n)l<i<m) \ \ P l-^n] © ©OO. 


Then the following hold. 

(i) EnGN^III^^ri “ < +00 ^ - P2,i,n\?\^n] < ©OO 

P-a.s. 

(ii) There exist a V-valued random vector x and a V-valued random vector (©i,... ,Vm) such that 
the following hold. 

(a) Xn^X and J-y„A{Xn - ln{CXn © Ei^l © InZ) ^ X P-a.S. 

(b) (Vi G {1, . . . ,m}) ^ © and J^^^-l{Vi^n + ln{LiXn-Df^Vi^n) -InTi) ^Vi P-a.S. 
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(c) Suppose that A or C is uniformly monotone at x{co) for every uj & fl C ft with P(fi) = 1, 

then Xn^X and J^„A{Xn - ln{CXn + YjT=1 + Inz) X P-a.s. 

(d) Suppose that or D~^ is uniformly monotone at Vj{uj) for every a; G 17 C with 

P(ri) = I, for some j G m}, then Vj^n Vj and ^-i(vj^n + 7n{LjXn — 

- InTj) Vj P-a.s. 


Proof. Set 


A: K 


iTC-. 


(x, i;i,..., Vm) (-Z + Ax) X (n + x ... x (r^ + Xm) 


B. K-> K-. {x,Vi,.. .,Vm) ^ [Cx + YT=1 - LiX, . . .,D^^Vm - LmX 


(4.9) 


Since A is maximally monotone [5l Propositions 20.22 and 20.23], B is monotone and /3-Lipschitzian 
[111 Eq. (3.10)1 with domS = /C, A-\-B is maximally monotone [5l Corollary 24.24(i)]. In addition, 
O Propositions 23.15(ii) and 23.16] yield (Vy G ]0,+oo[)(Vn G N)(V(x,ni,... ,Vm) G K) 


J-/a{x,vi,.. .,Vm)= (^J-yAix-^-jz), - 7^i))i<i<m)- 


(4.10) 


It is shown in [TTl Eq. (3.12)] and [HI Eq. (3.13)] that under the condition (14.2p . zer(A + S) 7 I 0. 
Moreover, m Eq. (3.21)] and [HJ Eq. (3.22)] yield 


{x,vi,..., Vm) G zer(A + B) ^ x solves (|4.3p and (xi,..., Vm) solves (jiai). 
Let us next set, for every n G N, 


(4.11) 


Vn ~ {yi,n'} y2,l,n') • • • ; 2/2,771,n) 

Pn — (Pl,n; P2,l,n? • • • ;P2,m,n.) 

Qn ~ (^1,77? ^2,1,77; • • • ; Q2,m,n) 


and < 


^77 — (^1,77? ^2,1,77; * * * ; ^2,777,77) 
^77 — (^1,77; ^2,1,77; * * * ? ^2,777,77) 
^77 — (Cl,r7) ^2,1,77; * * * 5 ^2, 777 , 77 )* 


(4.12) 


Then our assumptions imply that 

^ yE[|||a„|||2|:E„] < 00 , ^ ^/B[\\\bnW\J^n] < 00 , and ^ < 00 . 


nGN 


nSN 


nSN 


(4.13) 

Eurthermore, it follows from the definition of B, (|4.10p . and (|4.12p that (14.7h can be rewritten in 
K as 

Vn — 'JniBXji CLn) 

Pn ~ J-ynAVn + 

(ln=Pn- ln{Bp^ + Cn) 

Xn+1 — ~ Vn 4 “ Q^ni 

which is (I3.32p . Moreover, every specific conditions in Corollary 13.21 are satisfied. 


(Vn G N) 


(4.14) 


F] By Corollary EneN^llFn - Pr, 


\Tn] < oo. 


(ii)[ a)& (ii)(b) It follows from Corollary 13.^111)] that 

Xn ^x and (Vz G {1,..., m}) Vi^r 


Vi P — a.s. 


(4.15) 
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Corollary I3.1^lfii)| shows that (x, vi,..., Vm) € zer(A + B). Hence, it follows from [TTl Eq (3.19)] 
that (x,Ui,... ,Vm) satisfies the inclusions 


[ “ L*Vi - Cx e -z + Ax 
I (Vi G {1,, m}) LiX - D^^Vi G r* + B~^Vi. 

For every n G N and every i G {1,..., m}, set 

f 2/1,n = Xn — ^niCXn + X]j=i L*Vi^n) j 112,i,n = Vi^n + ln{LiXn ~ Vi^n) 

\pi,n = J-y„A{yi,n + Jn^) \p2,i,n = (l/2,i,n ~ Infi)- 

We note that (I4.13p implies that 

^[lll®n||Pl-^ n] 0, E[|||6„||p|.^n] 0 and E[|||c, 2 |||^|.^n] “t 0 P-a.s. 

Then, using [5l Corollary 23.10], we get 

/ l|Pl,n ~ Pi,nil ^ 11^1,nil + P ||®l,n||) 

[(Vi G {1, . . . ,m}) llp2,i,n -P2,i,n|| < ||^2,i,n|| + I3~^\\a2,i,n\\, 
which and (|4.18l) imply that 

f B[\\pi^n - Pl,n|P|i^n] < 2E[116p„ll2 + ]]OgnP|i?^n] ^ 0 P-a.S. 

[(Vi G {1, . . . ,m}) E[l]p2,i,n -P2,i,n|p|i^n] < 2E[1162,i,n |P + ||a2,i,n iPji^n] 0 P-a.S. 


(4.16) 


(4.17) 


(4.18) 


(4.19) 


(4.20) 


Since (x,i;i ... ,Vm) i-t J'y„Aix - 'yn[Cx + Ya=i ^'^i) + Inz) is continuous from K ^ Ti, pi,n is 
.^ri-nieasurable. By the same way, for every i G {1,... ,ut,}, P2,i,n is .^n-measurable. In turn, by 
(i)|(ii)(a)~ and (ii)(b), we obtain 


l,n Xn\\ — E[]]pi ^,2 X,^]] \y~ fi\ ^ 2E[]]pi^^ Xn\\ llpi,n Pl,n,|| n] t 0 P a.S. 

2 _ Triril;^ Il 2 | 


(Vi G {1, . . . , TTl} ) j jp2,i,n ^i,n II — E[]]p2,i,n 1^1,7111' j*^ n 


— 2E[]]p2,i,n P2,i,n|| T ||P2,i,n I’i.nll n 

Pi^n X P-a.s. and (Vi G {1,... , m}) p2,i,n ^ Vi P-a.s. 


2 ,nil I*' nj 


0 P-a.s. 


(ii)(c) We derive from (|4.17p that 


(Vn G N) I ~ ^bn) - YT=1 - CXn G -Z + 

[ (Vi G {1, . . . , m}) Jn^iVi^n - P2,i,n) + TjX^ - D~^Vi^n ^ Vi + B~^P2,i,n- 


(4.21) 

(4.22) 


Let fia be the set of all a; G Li such that (x„(a;) — x(a;))„gN 5 (pi,n(<^) — a^(‘^))nGN and (Vi G 
{1,..., m}) (uj,n(a;)-Tj(w))neN, {P 2 ,i,ni‘x)-Vi{uj))nm are bounded, and (Vi G {1,..., m}) P 2 ,i,ni‘x)- 
Vi,niix) -A 0, pi^niix) — Xnito) -A 0. Set = fls C ft. Then 0,4 has probability 1. Now fix cu G ^ 4 . 
Since A is uniformly monotone at x(a;), using (|4.16p and (I4.22D . there exists an increasing function 
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(/>yl: [0, +oo[ —>• [0, +oo] vanishing only at 0 such that, for every n G N, 


(pA{\\pi,n{^) 


ta;)||) ^ (pi,n(w) - x{uj) I 7 ^(xn(a;) 




m 


- Xn(w) 

= {Pi,n{^) -x(cj) I 7"^(a:„(a;) -pi,„(a;))) - Xn(uj} 

m 

- I L*Vi^n{oo) - L*Vi{^)) > (4-23) 

i=l 


where we denote (Vn G N) Xn(w) = {pi^n{oj) — x{uj) \ Cxn{oj) — Cx{uj)). Since {B- are 

monotone, for every i G m}, we obtain 

(Vn G N) 0 ^ {p2,i,n{oj) - Vi{uj) I LiXn{oj) + 7 “^(Uj,n(a;) - P 2 ,i,n(w)) - Lix{oj)) - Pi,n(u}) 

= {P2,i,n{oj) -Vi{uj) I Li{Xn{uj) - x(uj)) + 7 “^(w) - P2,i,n(c^))) -/3i,n(w), (4.24) 

where (Vn G N) = {p 2 ,i,n{<^) \ D~^Vi^n{i^) - D~^Vi{uj)). Now, adding (|4.24D from 

i = 1 to z = m and (|4.23p . we obtain, for every n G N, 


9^A(||pi,n(w) - a;(a;)||) < (pi,n(w) - x{uj) \ 7 „^(x„(w) -pi,„(w))) 

/ m ^ 

+ (pi^nic^) -x{uj) I ^L*(p 2 ,i,n(w) - Vi,n(a;)) 


i=l 


+ X] (^’2,i,n(w) - 'yj(w) I Li{Xn{oj) - Pl,n(w)) + 7„ H^'i,n(w) “ P2,i,n{oj))) 

i=l 

m 

- Xn(w) - X] A.n(^)- (4-25) 


2 = 1 


For every n G N and every i G {1,..., m}, we expand Xn{^) and /3i^ri(a;) as 


Xn(w) = (a:n(w) - x(a;) | Cxn{(x) - Cx{u)) + {pi,n{oj) - Xn{uj) I Cxn(u}) - Cx{u)) , 

< = {xiA^) -XiA) I D^ViAA - ^AviA)) (4-26) 

+ {p2,iAA - viAA I dAvzAA - D:[AiA)) ■ 


By monotonicity of C and {D- ^)i<i<m, 


(Vn G N) 


{XnA) ~ xA) I CXnA) ~ CxA)) > 0, 

(Vi G {1,..., m}) {viAA - XiA) I D^ViAA “ DAviA)) > 0- 


(4.27) 
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Therefore, for every n G N, we derive from (|4.26ll and (|4.25|) that 


</>A(||Pl,n(w) - a;(w)||) < 4>A{\\Pl,niu}) - a:(u;)||) + {Xn{u}) - x{uj) \ CXniuj) - Cx{u))) 

m 

+ ^ {vi,n{oj) - Viiiv) I - D~^Vi{uj)) 

i=l 

< I ln^{Xn{ui) -pi,n(w))) 

+ (Pl,n(w) - X(w) I ^L*(p2,i,n(w) “ ) 


i=l 


+ X] (^’2,i,n(<^) - Vi{uj) I Li{Xn{uj) - Pl,n(w)) + ^(w) - P2,i,n(w))) 

2=1 

- (pi,n(w) - a:„(a;) | Cxn{uj) - Cx{oj)) 

m 

~ ^ (P 2 ,i,n(w) - Wj,n(w) | D~^Vi^n{^^) - D~^Vi{oj)) . (4.28) 


2=1 


We set 


C(w) = max sup{||xn(a;)-x(u;)||, ||pi,n(w)-x(a;)||, - t>i(a;)||, ||p 2 ,j,n(w) -•Ui(a;)||}. (4.29) 

Then it follows from the definition of S 74 that C{^) < oo, and from our assumption that (Vn G 
N) 7 “^ < s~^. Therefore, using the Cauchy-Schwarz inequality, and the Lipschitzianity of C and 
(Z)“^)i<i<m, we derive from (|4.28p that 


(l>A{\\pi,n{^) -a;(w)||) < e ^Clkn(w) -Pl,n(w)|| + C X] (11^*11 ll®^(^) - Pl,n{^)\\ 

2=1 

( m 

2=1 
m 

+ Z^o||Pl,n(w) - X„(a;)|| +'^iyi\\p2,i,n{^) - Vi^n{^) 

-A 0 . 


2 = 1 


(4.30) 


We deduce from (I4.30p and (I4.2ip that (j)A{\\pi,n{^^) — ®(w)||) —)• 0, which implies that pi^n{^) 
x{uj). In turn, x„(w) —)■ x{oj). Likewise, if C is uniformly monotone at x{oj), there exists an 
increasing function ^ [Oj +oo[ -A [ 0 , +oo] that vanishes only at 0 such that 


(t)c{\\xn{uj) -x(a;)||) < e ^CIkn(w) -p7n(w)|| +c'^ {\\Li\\ \\xn{(x) -P7„(a;)|| 

2=1 

/ m 

+ e"^|IWn(w) -P2,i,n(w)||) + ll^*lll|P 2 ,i,n(w) - Ui,n(w) 


+ Z^o||Pl,n(w) - Xniuj)\\ + ^ r'i||p2,j,n(w) “ ?^i,n(w) 

to. 


2 = 1 


(4.31) 
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in turn, Xn(co) x(u!). 


(ii)(d) 


Proceeding as in the proof of (ii)(c' 


we obtain the conclusions. □ 


We provide an application to minimization problems in m Section 4] which cover a wide class 
of convex optimization problems in the literature. We recall that the infimal convolution of the 
two functions / and g from Ti to ]—oo, +oo] is 


fag:x^maf{y)+g{x-y)). (4.32) 

y£H 

The proximity operator of / G ro('H), denoted by proxj, which maps each point x £ H to the 
unique minimizer of the function / + ^||x — - p. 


Example 4.3 Let m be a strictly positive integer. Let ^ be a real separable Hilbert space, let 
z £7i,let f G To{7i), let h: ^ M be convex differentiable function with z^o-Lipschitz continuous 
gradient, for some zzq £ ]0, +oo[. For every /c G {1,..., m}, let {Gk, (• | •)) be a real separable Hilbert 
space, let G Qk, let gk G ro(0fc), let £k £ ^oiGk) be 1/z/fc-strongly convex, for some Vk £ ]0,+oo[. 
For every k G {1,... ,ut-}, let —)• be a bounded linear operator. The primal problems is 

to 


minimize(/(x) - (x | z)) + Y] (4 □ gk)) ( L^x - r*. ) + h(x), (4.33) 

xgh ^^ V / 

k=l ^ ^ 


and the dual problem is to 


minimize 

n 


( m \ m 

L*Vi j + Y is* (vi) + 4* (vi) + {vi I r*)). (4.34) 

i=l ^ i=l 


We denote by Vi and Vi be the set of solutions to (I4.33P and (I4.34p . respectively. 
Corollary 4.4 In Example \4-3\ suppose that 


z G ran (df + t L*((% □ dii){Li ■ -ri)) + VhV 
i=l ' 


(4.35) 


Let (ai^n)ngN) (fei,n)nGN; CLud (ci^ri)„gN be sequences of square integrable H-valued random vectors, 
and for every i G {!,..., m}, let (a 2 ,i,n)nGN, (4,i,n)neN; and (c 2 ,i,„)neN be sequences of square 
integrable Gi-valued random vectors. Furthermore, set 




max.{vQ, vi,.. 


m 


k'm\ T 



(4.36) 


let xo be a square integrable H-valued random vector, and, for every i G {!,...,m}, let Vifi be 
a square integrable Qi-valued random vector, let e G ]0,1/(1 +/3)[, let (7n)neN be a sequence in 


18 










[e, (1 — e)//3]. Set 


yi,n — Xn hi^Xn') + “1“ ®l,n) 

Pi^n = prox^^y(yi,„ + 7„z) + 6i,n 
for i = 1,..., m 


(Vn E N) 


y2,i,n — ^i,n “1“ ^ni^LiXyi ('i^i,n) ~l~ ®2,i,n) 

P2,i,n = prOX^^g, (y2,i,n “ Tn^’i) + &2,i,n 
Q2,i,n — P2,i,n “i“ '^ni^I-‘iPl,n ^^P2,i,n) C2,i,n) 

^i,n+l — ^i,n ?/2,i,n “1“ Q2,i,n 
Ql,n — Pl,n 'yni^h(j)\^n) “1“ X^i=l ^iP2,i,n ^l,n) 
Xn+1 — 2/1,n “1“ 0.1,n- 


Suppose that the following conditions hold for Tn = o'((xfc, {vi^k)i<i<m)o<k<n, 


XyngN ^/^[l I |(cii^-n,, (fl2,j,n)l<i<m) 11 P1-^ n\ < +00 
XyneN '\/E[||(6i^n,) (&2,j,n)l<i<m) 11 P1-^n] < +00 

, XyneN 11 {^l,n^ (C2,i,n)l<i<m)| I P I'^n] < +00. 


Then the following hold. 


(4.37) 


(4.38) 


(i) EneN E[||Xn - Pl,n\\‘^\iFn] < +00 and (V/ E {1, . . . , m}) E[|ki,n - P2,i,n|p|^n] < + 00 . 

(ii) There exist a Vi-valued random vector x and a Vi-valued random vector (vi,... ,Vm) such 
that the following hold. 

(a) Xn^x and prox.^^y(x„ - 7n(V/l(Xn) + YT=i + Inz) X P-a.s. 

(b) (Vi E {1, . . . , m}) Vi^n Vi and prox^.^^* (vi^n + -in{LiXn - Vl*{vi^n) - InVi) Vi P-a.s. 

(c) Suppose that f or Vh is uniformly convex at x{uj) for every to £ fl C ft with P(ri) = 1, 

then Xn^x and prox.^^j(x„ - 7 n(V/i(xn) ^ L*Vi^n) + 'Inz) x P-a.s. 

(d) Suppose that g* or i* is uniformly convex at Vj{u}) for every a; E C with P(ri) = 1, 
for some j E {1,... ,m}, thenvj^n Vj and prox..^^g* {vj^n+Tn{LjXn-^i*{vj^n)-7nrj) 

Vj P-a.s. 

Proof. Using the same argument as in the proof HD Theorem 4.2], the conclusions follows from 
Corollary 14.21 □ 

Remark 4.5 Here are some comments. 


(i) By using Remark 13.11 an extension of Corollary 14.21 to the yariable metric setting is straight¬ 
forward. 

(ii) Almost sure conyergence for some primal-dual splitting methods solying composite monotone 
inclusions and composite minimization problems are also presented in [mm]. 

(hi) In the deterministic setting and in the case when each ij- is the indicator function of {0}, 
and (V/c E {1, • • • ,m})rk = 0, and 2 = 0, a preconditioned algorithm for solying (|4.33p can 
be found in [22] - 
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